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PRE FA C E 


The Examination Research Cell (ERC) of the Association of 
Indian Universities has been from time to time investigating into various 
fundamental issues of university examinations like Grading, Test and Item 
Analysis, Practical Examinations. Continuous Internal Assessment to 
mention only a few. Results of these research projects have already been 
reported in the form of Monographs, some of which have been revised In 
subsequent editions to include experiences of teachers/colleges/universities* 


At the same time, a few research studies have been conducted 
and It was felt that a series of Research Abstracts should be brought 
out incorporating the results of such studies. The present Research 
Abstract is fourth in the series and it is exclusively to report the Examlntlon 
result of test and item analysis of a test given by National Academy 
of Medical Sciences in their MNAMS Phrt I Examinations. What is reported 
here is an analysis of an objective type test of 150 items .taken by 221 candidates. 

A very comprehensive computer programme has been used to mark 
the scripts, to perform statistical analysis of the test and of various items and 
Is also included in this Research Abstract. 

It Is hoped that teachers, examiners and other examining bodies 
will find this Research Abstract useful. 

Constructive suggestions will be most welcome. 


New Delhi 

10th November, 198l 


V. Natarajan 
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A COMPREHENSIVE STATISTTICAI ANAIYSIS OF 
A SAMPLE OBJECTIVE TYPE TEST. 
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USE OF OBJECT IV E TESTS 


Objective type tests in our country are increasingly being used to 
serve different purposes in different situations. A beginning of it was seen 
in class roorr tests by several teachers with the main purpose of checking 
learning and diagnosing the weaknesses of it. Soon its use has been extended 
as a part of summative evaluation to check on the levels of achievement at 
the end of a course of study. Very recently we have seen objective type 
tests being used in admission and selection type tests. 

While tne attempts to use objective forms of assessment, have 
not taken roots yet, many acnievement tests purely of objective forms are 
used particularly by organisations wanting to select a few among the many 
achievers of the previous qualifying courses. 

In tne present context therefore, this objective type test used 
by the National Academy of IV'edical Sciences for their Part-I,MNAMS 
examination, is a test of attainment or proficiency in tne subject of medicine, 
being acquired by the candidates in tneir previous qualifying courses. 

Of course the content anj the intellectual abilities and skills associated with 
this content were all sorted out by a group of experienced and expert item 
writers, before assembling a collection of nearly thousand ^ ultiple-cnoice 
type items at the end of a 2 week long workshop to produce such items. 

One hundred and fifty of these were selected on the basis of the table of 
specifications and put into tnis test. 

This test therefore deals with a certain body of contents and related 
intellectual abilities involved in this. The main purpose of this test is to dis¬ 
criminate between the more able and less able candidates on the basis of 
performance in the test. It is therefore imperative that the items used in the 
test should have a nigh degree of discrimination. 

Tnere are two aspects of the whole test that need to be elaborated. 

One of these is the "validity" of the test. By this it is meant that the items 
used in the test measure the identified abilities in different areas of content 
in a balanced manner. This is done through a table of specifications or a blua 
print that specifies weightages to different areas of content and also weightages 
to different abilities. This largely accounts for the content validity of the test. 

The second of these is "reliability". By this, it is meant that the test measures 
consistently whatever it measures. In other words, the reliability of the test 
is its ability to produce more or less the same score for the same individual 
candidate. No test is known to have a hundred percent reliability. The coefficient 
of reliability is estimated by different methods. Usually the most probable value 
of reliability can be estimated out of all these. 
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Some crite ria used for the Construction an d Administration of this objective 
test: Arrangement of Items: 

One method is arrange the items in order of difficulty, 
usually the difficulty increases (i.e. Facility Value/ F.V. decreases) as the 
test proceeds. It would probably be better to form groups of items, each 
group containing items of approximately equal facility, rather than to try 
to arrange them in a fine gradation of facility from start to finish. It is a 
common practice to put one or two easy items at the beginning of a test on 
the psychological grounds that they will give candidates confidence and put them 
at ease. It is sometimes arranged according to some other method and let 
facility take care of Itself. 

A more common and defensible practice is to arrange items in 
groups corresponding to some acceptable classification of subject matter. 

Another criterion is that items should be grouped according to their types, 
if there is more than one type of item used within the test. This way all 
multiple choice items would be grouped together, all multiple completion 
would be in another group, and so on. In a mixed objective type test, this 
grouping by item type is essential,or it becomes confusing for a student 
to move at random from one type of item to another. While considering the 
arrangement of items one should keep an eye on the sequence of keys, that 
is, the letters which denote the correct response. It Is usually thought to be 
undesirable to have a prolonged run of identical keys such as a long sequence 
of 'A's or even a set pattern of responses to get repeated over the items. 

Lay-Out of the Test : 

Clarity of lay-out Is important. It is easy enough for a student to 
become confused when dealing with a single complex item. It is possible to 
arrange items in a double column on each side of the paper but only if the items 
themselves are short and simple. Even then, the order and numbering of the 
items should be logical and consistent. 

Recording the Responses 

There are various ways in which the responses of the candidates can 
be recorded. In large scale examining the use of some form of answer (respons 
sheet) is preferred. This answer sheet may dther be given separately or be 
detached from the testbooklet. There are three main types of answer-sheet 
outlined briefly below but in all the three the use of a soft lead pencil is 
advocated because it facilitates correction if a candidate should have a .change 
of mind. 

i) The first type of answer sheet requires to write the letter 
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or number corresponding to the chosen response to each Item, 
for example : 


Blank Answer Sheet 

i. z=7 2. nu 

3 . a 7 4 . cu 


Completed Answer Sheet 

1. Z57 2. /TT 7 
3. £U 4. Z2I7 


II) In the second type of answer sheet the candidate marks usually 
by a circle* or a cross or a tick, the letter or number corres¬ 
ponding to the chosen response. For example : 


Blank Answer Sheet 

1. A B C D 

2. A B C D 

3. A B C D 


Completed Answer Sheet 

1. © B C D 

2. A B © D 

3. A ® C D 


III) The third type is used mainly when tests are marked by machine. 
It requires candidates to fill In completely a small lettered or 
numbered space by means of a pencil mark. When fed through 
a scoring machine (Scanner), which can detect the positions of the 
pencil marks and which Is programmed to distinguish between 
correct and Incorrect scores* each answer-sheet Is automatically 
scored. For example : 


Blank Answer Sheet Completed Answer Sheet 



A 

B 

C 

D 


A 

B 

c 

D 

1 . 

0 

0 

0 

O 

1 . 

O 

• 

0 

0 

2. 

0 

O 

O 

0 

2. 

O 

O 

o 

• 

3. 

O 

0 

O 

0 

3. 

• 

O 

0 

0 


The response pattern shown in (III) has been used In this test. 


Items Analysis : 

Every item In a test should contribute something to the assessment 
one Is trying to make. In order to see that every Item does Indeed 
carry part of the load* some statistical analysis is necessary. Analysis 
of test Items not only helps us to identify poor items, bid also decide 
why an item is not functioning as it was planned.to do. The objective 
type Items have an advantage over most other forms of questions that 
their performance under operational conditions can be quantitatively 
analysed and evaluated after they have been used. 
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Item analysis yields three Indices that can be calculated for 
every Individual Item . These are : 

A) Facility Value for Difficulty Value) 

B) Discrimination Index for Discriminating power) 

C) Effectiveness of Dlstractors 

A) Facility Value for Difficulty Value) : 

The facility value of an item Indicates how easy or difficult 
it proved to be and it Is determined by calculating the percentage of 
candidates who answered It correctly. It Is usually shown as a 
percentage and rarely as a decimal fraction. 

Total number of candidates , _ n 

who attempted the Item 

Number of correct responses to the item (R) = 63 

Facility of this item (FV) = Number of candidates answering 

the item correctly _ 

Total Number who attempted this iter 

l) if calculated in Percentage. FV= 
FV=-§§ x 100 = 70% 
il) if calculated in decimal fraction, FV= 
FV = -!$ = 0.70 

In actual practice, a range of difficulty is allowed, e.g. 
between 40 and 80 percent for four option multiple choice items 
and 55 and 85 percent for true/false items. These limits are 
admittedly arbitrary and are provided only as general guidelines. 

If tests are used to produce a rank order, every item in the 
test must have a certain amount of facility. An item which is 
either answered correctly or incorrectly by all does not serve 
any useful purpose. In one case the Item in too easy while It 
Is too difficult in the other. Therefore, it is advisable to avoid 
both the very difficult and the very easy Items. 

B) Discrimination Index for Discriminating Power) 

This statistic shows the degree to which a particular item 
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discriminates between the higher ability and lower ability 
candidates. For convenience ability is here defined in terms 
of how well students do the test as a whole. If a particular 
item is to contribute to the discriminatory function of the 
whole test, the higher ability candidates should obtain a 
greater proportion of correct responses than the lower 
ability candidates. There are several ways in which It can 
be quantified. However, a simple procedure to calculate the 
D.I. value is given below: 

1. Arrange the students in rank order according to their 
scores on the test as a whole. 

2. One third of answer scripts at the top and the one 

t hird at the bottom are to be separated. (Very often 
the top 27% of total number of students and the bottom 
27% of total number of students are taken for purposes 
of accuracy of results) 

3. For each item count the number of correct responses (N^) 

obtained by the top third and count the number of 1 

correct responses (N.) obtained by the bottom third. If 
27% is adopted, count the number of correct responses 
obtained by the top 27% (N^) and also count the number of 
correct responses obtained by the bottom 27%. 

4. Count the number (n) of students constituting one third of 
all the students who took the test, (or number of students 
in 27%) 

5. Calculate the discrimination of the Item (DI) with the help 
of the following formula; 

D.I. - N H - \ 
n 

For example : 

n =30 (one third of all students) 

N = 27 i.e. 27 out of 30 answered correctly 

H 

= 15 i.e. 15 oat of 30 answered correctly 

n t _ _JLlilJL= —12— =: 0.40 

DI * 30 30 

if top and bottom 27% are adopted, we get Johnson's upper-lower 
index of D.I. 

It follows that if an item is to contribute to the total dis¬ 
criminatory power of the test, N„ must be greater than N. 
and, therefore, DI must be poslme. The two extremes would 
be : 
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i) n = 30, N = 30, N T = O 

rl lu 

therefore DI = ^ ^ = + 1 

30 

U) n = 30, N =0, N t = 3C 

H L 

therefore DI = ® 30 = - 1 

30 


ill) n = 30, N = 20, N = 20 

H Li 

20 - 20 

therefore DI = - = O 

An explanation for each of the tnree above mentioned cases is 
given below: 

i) In this case the item is discriminating positively between 
the higher ability and the lower ability candidates and is 
making maximum contribution. 

ii) In this case the item is also discriminating totally but 
in the opposite direction; that is the higher ability 
candidates on the test as a whole are answering incorrectly 
and vice- versa. 


HI) In this case > the item is maxing no distinction between 

the higher ability and lower ability candidates; it is having 
neither a positive nor a negative effect on the discriminating 
power of the whole test. 


With a view to make a thorough study of an objective type test on 
the lines mentioned above, a test with 150 items was tried out on a sample of 
223 medical cardidates. The details of the nature of the test and its analysis 


are given below: 


Subject Matter and 

Nature of the test: 

Medicine and Allied Sciences 
MNAMS (Primary Paper-1) 
Objective Test 

Number of candidates: 

221 

Number of items: 

150 
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IVaximum IVferks : 150 

Time : 3.00 Hours 

About the Test: 

This is an objective type test. It consists of 150 items which are 
divided into three sections namely Section-'A’, ’B’ and 'C*. 

Section - 'A* 

This section contains seventy five items. Each item is of multiple- 
choice type and has got four suggested answers. Every item has one and only 
one predetermined correct answer. 

Section - 'B * 


This section contains forty eight items of multiple true-false type. 

The candidates were asked to indicate for each item whether the statement of 
the item is true or false. 

Section 

This section contains twenty seven items. There are two statements 
given In each item. The first statement is in the form of an assertion while the 
second is in the form of a reason. The candidates were asked to choose the 
correct response indicating either 'A' or 'B' or 'C' or ’D* or ’E'. The candidates 
were given the following instructions: 

i) use 'A' if assertion is true, reason is true and reason is a correct 
explanation. 

ii) use ’B* if assertion is true, reason is true but reason is not a 
correct explanation of assertion. 

iii) use r C r if assertion is true, reason is false. 

iv) use ’D' if assertion is false, reason is true. 

v) use 'E* if both assertion and reason are false. 

With all these instructions the candidates were asked to shade the 
circle below the appropriate response on the answer-sheet. 

Sample 


The students who appeared for the part-I, MNAMS examination, were 
selected for studying the efficacy of the test and the efficiency of its Items. A 
total population of 221 candidates was found suitable for the study. 
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Administration 

An objective type test with 150 iterrs was administered 
to a sample of 221 candidates. They were given 3.00 hours to complete the 
test. The candidates were asked to attempt all the 150 items of the test. The 
candidates were further told not to write anything on the testbooklet. Separate 
answer-shteets were provided to every candidate which were collected from them 
after the allotted time. 

Scoring: 


All the 221 answer-scripts were manually scored with the help of a 
scoring key especially designed for the test items. Each item was given 
1 mark if it was correctly answered and zero mark if It was wrongly answered. 

In this manner all the ICO items were scored and their marks were tabulated 
for further analysis. 

Data Analysis 

The data were analysed with the help of various statistical techniques. 
Different values like mean, mode, median, standard deviation , variance and 
standard error of the mean were calculated. The reliability of the test by 
various methods was calculated. The data were also analysed with the help of 
analysis of variance technique to provide estimates of components of variation 
and to make valid conclusions. Derived scores in respect of Z-scores, 

T-scores, AGCT, CEEB scores and percentile ranks were also worked out for 
all the candidates in order to derive comparable scales. Items were also 
analysed to find out their facility and discrimination indices. 

Interpretation of the Results : 

The results of tne test are interpreted in the fallowing sequence: 

1) Mean, Mode, Median and Standard Deviation 

The scores obtained by the candidates are first of all arranged in 
an order (see table 1 . 0 ) to calculate some desired values. 

The range of the marks secured by the candidates In this test 
is found to be between 46 and 111. The minimum marks obtained by the 
candidates are 46 and the marks 111. The mean value of the test 
Is 78.9 It is seen from the range of the marks that a few candidates 
say only 9. 5 percent of the total population, have secured 100 and more 
than 100 out of 150 marks. Half of the candidates have secured less than 
51 percent marks on the test. The median of the test which indicates the 
middle candidate's score on the test is 77. It signifies that 77 is that 
point on the scale of measurement above which are exactly half the cases 
and below which are the other half and it seemsof course very true if we 
look at the marks of the candidates. The mode of the test which Indicates 
the maximum frequency In a distribution in this case happens to be exactly 
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similar to the median value. As .many as nine candidates have secured 
77 marks out of 150. The standard deviation of the test is 15. It 
indicates that a majority of the candidates have secured their marks 
in the range of 64 to 94 and this happens to be true. As many as 65 
percent of the cases are found within this range. Only 19 percent of 
cases are found above and 16 percent of the cases are found below 
this range. It also signifies that the marks obtained by the candidates are 
normally distributed. The standard error of the mean of the test is 1.015 
which indicates that the limits of marks within which the arithmatic mean 
will lie If we are to give this test over and over again would be only 1.015 
or It signifies that the limit of tolerance of mean Is 1.015. All these values 
are given in Table 1.1. 


Table - 1.0 

Frequency distribution of Marks * 


S- No. 

Marks 

Freauencv 

Cum Frea. 

1 

46.00 

2.00 

2.00 

2 

50. 00 

1.00 

3.00 

3 

51. 00 

4.00 

7.00 

4 

53.00 

4.00 

11.00 

5 

54 00 

2.00 

13.00 

6 

55. 00 

2 00 

15.00 

7 

56.00 

2.00 

17.00 

8 

57. 00 

1.00 

18.00 

9 

58. 00 

2.00 

20.00 

10 

59. 00 

3.00 

23.00 

11 

60. 00 

4.00 

27.00 

12 

61.00 

3.00 

30.00 

13 

62. 00 

1.00 

31.00 

14 

63.00 

3.00 

34.00 

15 

64.00 

4.00 

38.00 

16 

65. 00 

5.00 

43.00 

17 

66. 00 

8.00 

51.00 

18 

67.00 

5.00 

56.00 

19 

68. 00 

6.00 

62.00 

20 

69.00 

4.00 

66.00 

21 

70.00 

6.00 

72.00 

22 

71.00 

6.00 

78.00 

23 

72.00 

5.00 

83.00 

.24 

73.00 

1.00 

84.00 

25 

74.00 

6.00 

90.00 

26 

75.00 

7.00 

97.00 

27 

76.00 

6.00 

103.00 

28 

77. 00 

9.00 

112.00 

29 

78.00 

4. 00 

116.00 

30 

79.00 

2.00 

118.00 

31 

80.00 

2. 00 

120.00 

32 

81. 00 

3. 00 

123. 00 
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S. No 

Marks 

Freauencv 

Cum Frea, 

33 

82. 00 

4.00 

127.00 

34 

83. 00 

5.00 

132.00 

35 

£4.00 

3. 00 

135.00 

36 

85. 00 

6.00 

141. 00 

37 

86.00 

5.00 

146.00 

38 

87.00 

8.00 

154.00 

39 

88. 00 

6.00 

160.00 

40 

89. 00 

4.00 

164.00 

41 

90.00 

3.00 

167.00 

42 

91.00 

2.00 

169. 00 

43 

92.00 

3.00 

172.00 

44 

94.00 

7.00 

179.00 

45 

95.00 

4.00 

183.00 

46 

96.00 

6.00 

189.00 

47 

97.00 

1.00 

190.00 

48. 

98.00 

3.00 

193.00 

49 

99.00 

7.00 

200.00 

50 

100.00 

4.00 

204.00 

51 

101. 00 

1.00 

205.00 

52 

102.00 

2.00 

207.00 

53 

103.00 

3.00 

210.00 

54 

104. 00 

3.00 

213.00 

55 

105.0C 

1.00 

214.00 

56 

106. 00 

4.00 

218.00 

57 

no. oo 

2.00 

220.00 

58 

111.00 

1.00 

221.00 


+ Output from computer 


Table of some desired statistics * 
Table-1. 1 


Mean of Score 

78. 9005 

Median of Score 

77.0000 

Mode of Score 

77.0000 

Variance of Score 

226,9231 

Standard Deviation 

15.0640 

S.D. by Dietrich Method 

14 .8288 

Standard Error of the Mean 

1.0156 


"Output from computer 
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Percentile Ranking- 

A candidate's percentile rank describes his relative standing within 
a specified group. A percentile is one of the ninety-nine points dividing a 
frequency distribution into one hundred groups of equal size. The scores 
which serve to identify a person's status within a specified group may be 
expressed in a variety of forms. One convenient way of indicating the level 
of an individual's performance is to quote his percentile rank. This tells 
us what percentage of the group performed at a lower level. Thus if we 
compare an individual's mark with those obtained by the group as a whole, 
and find that when their marks are arranged in rank order he is exactly 
half way down the list, he would be said to be at the 50th percentile. In 
other words fifty percent of the group were below him in the list. If he 
faired better than 90 percent of the group he would have a percentile rank 
of 90 and so on. 

It is clear that this is a much more meaningful representation of 
an individual's performance than his total mark or percentage mark in an 
examination. Table 1.1a shows the percentile rank calculations of all the 
221 candidates. 


Table 1. la showing percentile rank calculation 


S. No. 

Marks (x) 

Frequency(f) 

Cumulative 
Freq. (Cf) 

Cumulative 
Freq. mid¬ 
point (Cfm) 

Cumulative 
Percentage of 
mid point (P. ] 

1 

111 

1 

22 : 

220.50 

99.77 

2 

110 

2 

220 

219.00 

99. 09 

3 

106 

4 

218 

216.00 

97.93 

4 

105 

1 

214 

213.50 

96.38 

5 

104 

3 

213 

211.50 

95.70 

6 

103 

3 

210 

208. 50 

94.34 

7 

102 

2 

207 

206.00 

93.21 

8 

101 

1 

205 

204.50 

92.53 

9 

100 

4 

204 

202.00 

91.40 

10 

99 

7 

200 

196.50 

8 8. f 91 

11 

98 

3 

193 

191.50 

86.65 

12 

97 

1 

190 

189.00 

85.74 

13 

96 

6 

189 

186.00 

84.16 

14 

95 

4 

183 

181.00 

81.90 

15 

94 

7 

179 

175.50 

79.41 

16 

92 

3 

172 

170.50 

77.14 

17 

91 

2 

169 

168.00 

76.01 

18 

90 

3 

167 

165.50 

74.88 

19 

89 

4 

164 

162.00 

73.30 

20 

88 

6 

160 

157.00 

71.04 


« 
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21 

&7 

8 

154 

150.00 

67.87 

22 

86 

5 

146 

143.50 

64.93 

23 

85 

6 

141 

138.00 

62.44 

24 

84 

3 

135 

133.50 

60.40 

25 

83 

5 

132 

129.50 

58.59 

26 

82 

4 

127 

125.00 

56.56 

27 

81 

3 

123 

121.50 

54.97 

2 b 

80 

2 

120 

119.00 

53.84 

29 

79 

2 

H 8 

117.00 

52.94 

30 

78 

4 

116 

114.00 

51.58 

V 

77 

9 

112 

107.50 

48.64 

32 

76 

6 

103 

100.00 

45.24 

33 

75 

7 

097 

93.50 

42.30 

34 

74 

6 

090 

87.00 

39.36 

35 

73 

1 

084 

83.50 

37.78 

36 

72 

5 

083 

80.50 

36.42 

3 1 

71 

6 

078 

75.00 

33.93 

3b 

70 

6 

072 

69.00 

31.22 

39 

69 

4 

066 

64.00 

28.95 

40 

6 b 

6 

062 

59.00 

26.69 

41 

67 

5 

056 

53.50 

24.20 

42 

66 

b 

051 

47.00 

21.26 

43 

65 

3 

043 

40.50 

lb. 32 

44 

64 

4 

038 

36.00 

16.2b 

45 

63 

5 

034 

32.50 

14.70 

46 

62 

1 

031 

30. 5C 

13.80 

47 

61 

3 

030 

28.50 

12 . 89 

40 

60 

4 

027 

25.00 

11.31 

49 

59 

3 

023 

21 .50 

9.71 

50 

5b 

2 

020 

19.00 

b. 59 

51 

57 

1 

01 b 

17.50 

7.91 

52 

56 

2 

017 

16.00 

7.23 

53 

5£ 

2 

015 

14.00 

6.33 

54 

54 

2 

013 

12.00 

5.42 

55 

53 

4 

Oil 

9.00 

4.07 

56 

51 

4 

007 

5.00 

2.26 

57 

50 

1 

003 

2.50 

1.13 

58 

46 

2 

002 

1.00 

0.45 


Reliability of the Tes t 

The reliability of the test calculated by various methods is given 

below: 

A. gpl il H fliygfi R s.liabjlj.ty 

In this method the test of 150 items is split into two halves namely: 
l) a test of odd numbered items and a test of even numbered items. 
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ft^arks obtained by candidates in odd numbered item test 
and even numbered item test are all found out. Product 
moment correlation is worked out to give the split halves 
reliability. 

il) another way of making two tests out of one is to take any 
random 75 items and constitute Into a test while the rest 
will be made into another. Candidate's marks on these 
two tests are found and product moment correlation found 
out. 

ill) yet another way to have two halves of the same 150 items 
is to take the first 75 items as a test and last 75 as 
another. Candidates' marks on these first 75 and last 75 items 
are found and correlated. 

Thus* all the 150 test items are divided into two halves by the 
three above mentioned methods and then the reliability by various methods Is 
calculated. The different values are given in Table 1.2. 

It is seen from Table 1.2 that the reliability of the test calculated 
by various methods is fairly high. In most of the cases, the reliability of 
the test is greater than 0. 85 or approximately C. 89 which is of course a 
very high value for a test of this type. It further signifies that the test 
items are nearly equal in difficulty and hence the reliability of the test is 
quite high. 


Table-1.2 

Reliability of the Tes t* 



Split halves 
reliability 

Spearman Rulon Formula 

Brown whole of reliability 
test reliabi¬ 
lity 

Flanagan 
Formula of 
reliability 

Odd even split 

C. 8080 

0. 8938 

0 . 8907 

0. 8907 

Random half split 

0.5878 

0.7404 

0.7310 

0.7310 

First-second half 

0.7740 

0. 8726 

0.8719 

0. 8720 


Reliability by Moiser short cut method = 0. 8080 

Reliability by KR-20 formula = 0.8753 

KR-I 20 form. Based on 27% HAG and 27% LAG = 0.92 84 
Another Form of KR-20 formula = 0.8408 

Reliability by KR-21 formula = 0. 8408 

Cronbach Coeff. Alpha = 0.8753 
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Lower bound estimate of exam, 
reliability 

Stanley Approximation 
Index of Measurement efficiency 
Reliability by Analysis of Variance 
Tucker Modified KR form. 


+ Output from Computer 


= 0.9079 
= 0 . 8809 
= 0.8942 
= 0.8753 
= 0. 8753 


The data were also analysed with the help of analysis of variance 
technique, for which the following hypotheses were developed: 

Development of Hypotheses 

In order to study the individual^ marks on the test items and 
also to study the effect of test items on the individual candidates the following 
null hypotheses were formulated. 

HO The individual candidates will not vary significantly 
1 on the test items. 

HOg The test items will not have any significant difference on 
the individuals' scores. 

In order to test the hypotheses developed earlier, the analysis of 
variance technique was used to provide estimates of components of variation 
and to make valid conclusions. The summary of the complete analysis of 
variance is given in Table 1.3. 


Table 1.3 

Analysis of Variance 


Source of 
Variation 

Sum of 
Squares 

Degrees of 
Freedom 

Mean Squares 
Error 

Variance 

Ratio 

Examinees 

334.3359 

220 

1.5197 

8.0177+ 

hems 

1717.5039 

149 

11.5269 

60.8l39 + 

Remainder 

6213.2344 

327 80 

0. 1895 



+ Significant at .05 and also at .01 level. 
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Analysis of Variance 

To study tne effect of individual student on the test items and also 
tne effect of test items on individuals' scores* tne data were analysed with 
the uelp of analysis of variance tecnnique. Tne hypotheses wnicn were for¬ 
mulated earlier were tested on the basis of the ’F' - values given in Table-1.3. 

Hypothesis - I 


Tnis hypotnesis states that the individual candidates will not vary 
significantly an tne test items. 

It is seen from Table 1.3 that the calculated value of 'F‘ in relation 
to examinees is greater (F = 8.0177) than the tabulated value, therefore, the 
null hypothesis is rejected. It means that the individual candidates differ 
significantly on the test items. The ’F' ratio for examinees is significant 
beyond the .01 point, leaving us with considerable confidence that the examinees 
difference, as such, have a real bearing upon the difficulty of the items of the 
test. 

Hy po thesi s - II 


Tnis hypothesis states that tne test items will not have any significant 
difference on tne individuals' scores. 

It is seen from Table 1.3 that the calculated value of 'F' in relation 
to items is greater (F=6C,8i39) tnan the tabulated value, therefore, the null hy¬ 
pothesis is rejected. It indicates tnat the test items have a significant difference 
on the individuals' scores. Tne F-ratio for items is significant beyond the 
.01 point, leaving us with considerable confidence tnat tne items, as such, have 
a real bearing upon the individuals' scores. 


Item Analysis 


1. Facility ValueiF. V. ) 

The facility value of an item indicates how easy or difficult it 
proved to be and is determined by calculating the percentage 
of candidates who answered it correctly. Usually the facility 
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value of an objective type test item must range from 20% to 85%. 

The various standards suggested to check the facility value of an 
objective type Item are given below: 

At trial test stage 

0 to 25% F. V. item Is too hard (modify, check distractors) 

25% to 75% F.V. Item of correct facility 

75% to 100% F.V. item is very easy (reword, reject, check for clues) 

After trial but in actual use 

0 to 25% topic not taught well/not learnt well 
(check teaching learning technique) 

25% to 75% topic reasonably taught well/learnt well 

75% to 100% exceptionally good knowledge of topic 

2. Discrimination Index (D.I.) 

Tals is an important item analysis characteristic for 
an objective type test item. Tne quality of an item in distinguishing 
between iiigner ability and lower ability candidates is technically called 
discrimination. The statistics showing discrimination value is called 
discrimination index. These indices range from - 1.0 to +1.0. A 
good quality item snould discriminate between candidates who have ach¬ 
ieved well and those wno have not. The main purpose of discrimination 
index is to tell us if an item really is showing differences between 
more capable candidates and less capable candidates. The various standards 
suggested to cneck tne discrimination index of an objective type item 
are given below: 

0.6 and above: excellent items 
0.2 to 0.6: very good items 
0 to 0.2: needs improvement 
CO to be discarded 

Items wltn negative Dl should be rejected. 

The F.V. and D.I. for all the 150 items administered to a sample 
of 221 candidates were calculated, summarised and given in Table 3.0. 

The F.V. and D.I. values for Individual items are separately given. 
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Qn. 

No. 

% choosing 
Question 

Mean Ability 
Index 

Facility 

Value 

Discrimination 

Index 

Variance 

94 

100.0000 

78.4208 

0.9831 

0.033898 

0.008968 

95 

100.0000 

72.2127 

0.8559 

0.220339 

0.089638 

96 

100.0000 

74.9050 

0.9746 

-C.016949 

0.047296 

97 

100.0000 

72.2851 

0 . 9068 

0.186441 

0.089638 

98 

100.0000 

51.0724 

0.6271 

0.203390 

0.233309 

99 

100.0000 

59. 9050 

0. 7288 

0.101695 

0.189185 

100 

100.0000 

31. 8552 

0.3898 

0.542373 

0.230953 

101 

100.0000 

70.8959 

0. 8898 

0.186441 

0.103806 

102 

100.0000 

48. 9321 

0.5932 

0.576271 

0.244426 

103 

100.0000 

47. 7466 

0.5593 

0.305085 

0.242993 

104 

100.0000 

57.6968 

0.6864 

0.288136 

0.205729 

105 

100.0000 

17. 5204 

0.2542 

0.0 

0.172560 

106 

100.0000 

73.4887 

0.9576 

0.050847 

0.067157 

107 

100.0000 

50.1312 

0.5932 

0.508475 

0.240536 

108 

100.0000 

33.9140 

0.4237 

0.135593 

0.242993 

109 

100.0000 

4.3348 

0.0847 

-0.135593 

0.059335 

110 

100.0000 

62.9231 

0. 7966 

0.372881 

0.177515 

111 

100.0000 

12.0090 

0.1864 

0.067797 

0.123830 

112 

100.0000 

47. 8235 

0.5847 

0.288136 

0.243730 

1 1 3 

100.0000 

48. 1584 

0.6356 

0.118644 

C.239635 

114 

100.CC00 

40.1584 

0.5424 

-0.101695 

0.249872 

115 

100.0000 

69.0271 

0.8559 

0.254237 

0.123830 

116 

100.0000 

50.4389 

0.6102 

0.474576 

0.239635 

117 

100.0000 

42.3032 

0.5169 

0.423729 

0.249954 

118 

100.0000 

52.6516 

0.6864 

0.220339 

0.228374 

119 

100.0000 

33.3937 

0.4831 

0.050847 

0.242993 

120 

100.0000 

13.0724 

0.1525 

0.169491 

0.130177 

121 

100 . 0000 

27.3575 

0.3305 

0.288136 

0.219652 

122 

100.0000 

39.8959 

0.5000 

0.220339 

0.249872 

123 

100.0000 

63.7873 

0.7712 

0.186441 

0.162159 

124 

100.0000 

44. 0814 

0.5932 

0.271186 

0.248152 

125 

100.0000 

32.5520 

0.4068 

0.305085 

0.237710 

126 

100. 0000 

18.8461 

0.2288 

0.288136 

0.170021 

127 

100.0000 

22. 9412 

0.3136 

0.457627 

0.191397 

128 

100.0000 

27.4027 

0.3136 

0.389830 

G. 216416 

129 

100.0000 

31.6199 

0.4407 

0.101695 

0.242993 

130 

100.0000 

37.6832 

0.5169 

0.118644 

0.248848 

131 

100.0000 

20.0181 

0.2203 

0.033898 

0.186933 

132 

100.0000 

36.0633 

0.3983 

0.423729 

0.244426 

133 

100.0000 

33. 1674 

0.3729 

0.203390 

C. 240536 

134 

100.0000 

14.4118 

0. 1441 

0.016949 

0.148236 

135 

100.0000 

15.0045 

0.1610 

0.152542 

0.148236 

136 

100.0000 

13.8462 

0.1610 

0.118644 

0.139391 



Qa. 

Na. 

% choosing 
Question 

Mean Ability 
Index 

Facility 

Value 

Discrimination 

Variance 

137 

100.0000 

30.0090 

0.4068 

0.372881 

0.228374 

138 

100.0000 

42. 5565 

0.4915 

0.474576 

0.249954 

139 

100.0000 

24.9955 

0.2797 

0.322034 

0.207612 

140 

100.0000 

16.9231 

0.2373 

0. 135593 

0.162159 

141 

100.0000 

32.6244 

0.4068 

0.338983 

0.236686 

142 

100. 0000 

33. 7104 

0.3898 

6.305085 

0.241396 

143 

100.0000 

34. 5475 

0.3814 

0.457627 

0.240536 

144 

100.0000 

26.1584 

0.3051 

0.372 881 

0.209455 

145 

100.0000 

33. 8054 

0.4153 

0.423729 

0.240536 

146 

100.0000 

12.2217 

0.1525 

0.135593 

0.127024 

147 

100. 0000 

19.9955 

0.3136 

0.186441 

0.182306 

14 S 

100.0000 

21.4977 

0.2712 

0.271186 

0.186933 

149 

100.0000 

25.8145 

0.3220 

0.271186 

0.213018 

150 

100.0000 

11.6063 

0.1864 

0.203390 

0.114003 


+ Output frorr Corrputer. 
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If one looks at the F.V. and D.I. values of Individual items which are 
given in Table 3.0 one finds there are a few items which need further Improv¬ 
ement. Let us look at the F.V. and D.I. of all the items separately. 

It is seen from Table 3.0 that there are twenty items in the test which 
nave got high facility values. It signifies that these items are easy items and 
they are correctly answered by a large number of candidates. Against this 
there are twelve items which have got the least facility values. It shows that these 
are hard items and they are correctly answered only by a few candidates (that is 
why their facility values are less). It is therefore statistically proved that the 
items in t .e test are proportionately included. It shows an ideal combination 
of some easy, some hard and some medium items. In fact easy and hard items 
whica are contrary to each other have approximately an equal load on the test 
as a result of which there is a very good balance. ftfejority of the items are of 
medium difficulty and this is a very good sign of a well planned test. On the 
basis of these statistics we can precisely say that this test out of 150 items 
contains 12 hard, 20 easy and 118 medium items, which of course seems to be 
a very good combination. From the psychological point of view we must have 
some easy items in tne test (preferably in the beginning of the test) so that the 
candidates get some positive reinforcement by solving them. If one 

does not give the easy items in tne test, the candidates may get nervous. 

Since we have to discriminate the candidates of higher ability and lower 
ability which is the first and the formost purpose of the test, it is also 
necessary to include some hard items which could be solved only by the higher 
ability candidates. Apart from these two types of items i.e. hard items & easy 
items each test should have some items of medium difficulty. 

If we look at the D.I. values of the items given in Table 3.0, it is 
seen that there are twenty five items which have got negative D.I. values. It 
means that these items have failed to serve their purpose or in other words 
these items have failed in discriminating between the higher ability and lower ability 
candidates. It furtner signifies that these items are either to be rejected or 
modified. Apart from it there are thirty items in the test which have got less 
D.I. values. It does not necessarily mean that these items are not at all good 
items and therefore tney should be rejected. They need further improvement and 
it would be possible either by changing the distractors of the items or by conver¬ 
ting or re modifying the stems of the items. 

As a whole, the test is extremely good and it could be further improved 
if a few items which have shown less F.V. and D.I. values are slightly modified. 

Derived Scores 

It Is necessary to convert the raw score scales into other standard scales 
for various reasons. One objective is to effect a more reasonable scale of 
measurement. Anotaer important objective is to derive comparable scales for 
different tests. The raw scores from each test yield numbers that have no 
comparability with numbers from another test. There are many situations for 
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wanting not only comparable values from different tests but also values that 
have some standard meaning. These are the problems of test norms and 
test standards. It is almost certain that derived scores provide us with 
more nearly comparable values than do raw scores. No informed person 
would think of using raw scores as a basis of making direct comparisons 
among individual positions with respect to trait variables. Conversion of 
raw scores to values on some other common scale Is essential. Derived 
scores In respect of Z,T, AGCT. CEEB are worked out for all the 221 
candidates.Table 2.0 summarises the results of calculations. 

1. Z-scores have O for their mean and 1 for their standard 
deviation 

2. T-scores are linearly transformed Z scores with mean at 50 
and S. D. at 10. 

3. AGCT (100/20) 

4. CEEB (College Entrance Examination Board) 500/100 
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Table 2.0 + 


S. No 

Karks 

Z-score 

T-seore 

AGCT-score 

CEEB-score 

1 

111 

2.13 

71.31 

142.62 

713.09 

2 

T'O 

2.06 

70.64 

141.29 

706.45 

3 

^0 

2.06 

70.64 

141.29 

706.45 

4 

106 

•> 80 

67. 99 

135.98 

679.90 

5 

106 

1. 80 

67.99 

135.98 

679.90 

6 

106 

1.80 

67. 99 

135.98 

679.90 

7 

106 

1.80 

67. 99 

135.98 

679.90 

£ 

105 

1. 73 

67.33 

134.65 

673.26 

9 

104 

167 

66.66 

133.32 

666.62 

10 

104 

1.67 

66.66 

133.32 

666.62 

11 

104 

1.67 

66.66 

133.32 

666.62 

12 

103 

1.60 

66.00 

132.00 

659.98 

13 

103 

1 60 

66.00 

132.00 

659.98 

14 

103 

1.60 

66. 00 

132.00 

659.98 

15 

102 

1. 53 

65.33 

130.67 

653.34 

16 

102 

1. 53 

65.33 

130.67 

653.34 

IV 

101 

1.47 

64.67 

129.34 

646.70 

18 

100 

1.40 

64.01 

128.01 

640. 07 

19 

100 

1.40 

64. 0’ 

28.01 

640.07 

20 

100 

1.40 

64. 01 

128.01 

640.07 

21 

100 

1.40 

64.01 

128 . 01 

640.07 

22 

99 

1.33 

63.34 

126.69 

633.43 

23 

99 

1.33 

63.34 

126. 69 

633.43 

24 

99 

1.33 

63.34 

126.69 

633.43 

25 

99 

1.33 

63.34 

126.69 

633.43 

26 

99 

1.33 

63.34 

126.69 

633.43 

27 

99 

1.33 

63.34 

126.69 

633.43 

28 

99 

1.27 

63.34 

126.69 

633.43 

29 

98 

1.27 

62.68 

125.36 

626.79 

30 

98 

1.27 

62.68 

125.36 

626.79 

31 

98 

1.27 

62.68 

125.36 

626. 79 

32 

97 

1.20 

62.02 

124.03 

620.15 

33 

96 

1. 14 

61.35 

122. 70 

613. 51 

34 

96 

1. 14 

61.35 

122.70 

613.51 

35 

96 

1.14 

61.35 

122.70 

613. 51 

36 

96 

1.14 

61.35 

122. 70 

613.51 

3 t 

96 

-.14 

61.35 

122.70 

613.51 

38 

96 

1.14 

61.35 

122. 70 

613.51 

39 

95 

1.07 

60. 69 

121.37 

606.87 

40 

95 

1.07 

60.69 

121.37 

606.87 

41 

95 

1.07 

60.69 

121.37 

606.87 

42 

95 

1.07 

60. 69 

121.37 

606.87 

43 

94 

1.00 

60.02 

120.05 

600.24 

44 

94 

1.00 

60. 02 

120.05 

600.24 

45 

94 

1 . 00 

60.02 

120.05 

600.24 
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S. No 

Marks 

Z-sco re 

T-score 

AGCT-score 

CEEB-! 

46 

94 

1.00 

60. 02 

120.05 

600.24 

47 

94 

1.00 

60.02 

120.05 

600.24 

48 

94 

1.00 

60.02 

120.05 

600.24 

49 

94 

1.00 

60.02 

120.05 

600.24 

50 

92 

0.87 

58. 70 

117.39 

586.96 

51 

92 

0.87 

58. 70 

117.39 

586.96 

52 

92 

0.87 

58. 70 

117.39 

586.96 

53 

91 

0.80 

58.03 

116.06 

580.32 

54 

91 

0.80 

58.03 

116.06 

580.32 

55 

90 

0. 74 

57.37 

114.74 

573.68 

56 

90 

0. 74 

57.37 

114.74 

573.68 

57 

90 

0. 74 

57.37 

114. 74 

573.68 

58 

89 

0.67 

56. 70 

113.41 

567.04 

59 

89 

0.67 

56. 70 

113.41 

567.04 

60 

89 

0.67 

56. 70 

113.41 

567,04 

61 

89 

0.67 

56. 70 

113.41 

567.04 

62 

88 

0.60 

56.04 

112.08 

560.41 

63 

88 

0.60 

56.04 

112.08 

560.41 

64 

88 

0.60 

56.04 

112.08 

560.41 

65 

88 

0.60 

56.04 

112.08 

560.41 

66 

88 

0.60 

56.04 

112.08 

560.41 

67 

88 

0.60 

56.04 

112.08 

560.41 

68 

87 

0.54 

55.38 

110.75 

553.77 

69 

87 

0.54 

55.38 

110.75 

553.77 

70 

87 

0.54 

55.38 

110.75 

553.77 

71 

87 

0.54 

55.38 

110.75 

553.77 

72 

87 

0.54 

55.38 

110.75 

553.77 

73 

87 

0.54 

55.38 

110.75 

553.77 

74 

87 

0.54 

55.38 

110.75 

553.77 

75 

87 

0.54 

55.38 

110.75 

553 . 77 

76 

86 

0.47 

54. 71 

109. 43 

547.13 

77 

86 

0.47 

54. 71 

109.43 

547.13 

78 

86 

0.47 

54. 71 

109.43 

547.13 

79 

86 

0.47 

54. 71 

109.43 

547.13 

80 

86 

0.47 

54. 71 

109.43 

547.13 

81 

85 

0.40 

54.05 

108.10 

540.49 

82 

85 

0.40 

54: 05 

108.10 

540.49 

83 

85 

0.40 

54.05 

108.10 

540.49 

84 

85 

0.40 

54.05 

108.10 

540.49 

85 

85 

0.40 

54.05 

108.10 

540.49 

86 

85 

0.40 

54. 05 

108.10 

540.49 

87 

84 

0.34 

53.39 

106. 77 

533.85 

88 

84 

0.34 

53.39 

106.77 

533.85 

89 

84 

0.34 

53.39 

106.77 

533.85 

90 

83 

0.27 

52. 72 

105.44 

527.21 

91 

83 

0-27 

52. 72 

105.44 

527.21 

92 

83 

0.27 

52. 72 

105.44 

527.21 

93 

83 

0.27 

52. 72 

105.44 

527.21 

94 

83 

0.27 

52. 72 

105.44 

527.21 

95 

82 

0.21 

52.06 

104.12 

520.58 

96 

82 

0.21 

52.06 

104.12 

520.58 
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S. No 

Marks 

Z-score 

T-Score 

AGCT-Score 

CEE B-Score 

97 

82 

0.21 

52.06 

104.12 

520.58 

98 

82 

0.21 

52.06 

104.12 

520.58 

99 

81 

0.14 

51.39 

102.79 

513.94 

100 

81 

0.14 

51.39 

102.79 

513.94 

101 

81 

0.14 

51.39 

102.79 

513.94 

102 

80 

0.07 

50. 73 

101.46 

507.30 

103 

80 

0.07 

50. 73 

101.46 

507.30 

104 

79 

0.01 

50.07 

100.13 

500.66 

105 

79 

0.01 

50.07 

100.13 

500.66 

106 

78 

-0.06 

49.40 

98.80 

494.02 

107 

78 

-0. Ob' 

49.40 

98.80 

494.02 

108 

78 

-0.06 

49.40 

98.80 

494-02 

109 

78 

-0.#6 

49.40 

98.80 

494 . 02 

110 

77 

-0.13 

48. 74 

97.48 

487.38 

111 

77 

-0.13 

48.74 

97.48 

487.38 

112 

77 

-0.13 

48. 74 

97.48 

487.38 

113 

77 

-0.13 

48. 74 

97.48 

487.38 

114 

77 

-0.13 

48. 74 

97.48 

487.38 

115 

77 

-0.13 

48.74 

97.48 

487.38 

116 

77 

-0. 13 

48. 74 

97.48 

487.38 

117 

77 

-0.13 

48. 74 

97.48 

487.38 

118 

77 

-0.13 

48. 74 

97.48 

487.38 

119 

76 

-0. 19 

48.07 

96.15 

480.75 

120 

76 

-0.19 

48.07 

96.15 

480.75 

121 

76 

-0.19 

48.07 

96.15 

480.75 

122 

76 

-0.19 

48.07 

96. 15 

480.75 

123 

76 

-0.19 

48.07 

96. 15 

480.75 

124 

76 

-0.19 

48.07 

96.15 

480.75 

125 

75 

-0.26 

47.41 

94.82 

474.11 

126 

75 

-0.26 

47.41 

94.82 

474.11 

127 

75 

-0.26 

47.41 

94.82 

474.11 

128 

75 

-0.26 

47.41 

94.82 

474.11 

129 

75 

-0.26 

47.41 

94.82 

474.11 

130 

75 

-0.26 

47.41 

94.82 

474.11 

131 

75 

-0.26 

47.41 

94.82 

474.11 

132 

74 

-0.33 

46. 75 

93.49 

467.47 

133 

74 

-0.33 

46. 75 

93.49 

467.47 

134 

74 

-0.33 

46. 75 

93.49 

467.47 

135 

74 

-0.33 

46. 75 

93^49 

467.47 

136 

74 

-0.33 

46. 75 

93.49 

467.47 

137 

74 

-0.33 

46.75 

93.49 

467.47 

138 

73 

-0.39 

46.08 

92.17 

460.83 

139 

72 

-0.46 

45.42 

90.84 

454.19 

140 

72 

-0.46 

45.42 

90.84 

454.19 

141 

72 

-0.46 

45.42 

SO.84 

454.19 



29 


8. No 

Marks 

Z-sco re 

T-score 

AGCT-score 

CEEB-score 

142 

72 

-0.46 

45. 42 

90.84 

454.19 

143 

72 

-0.46 

45.42 

90.84 

454.19 

144 

71 

-0.52 

44. 76 

89.51 

447.55 

145 

71 

-0.52 

44. 76 

89.51 

447.55 

146 

71 

-0.52 

44. 76 

89.51 

447.55 

147 

71 

-0.52 

44. 76 

89.51 

447.55 

146 

71 

-0.52 

44.76 

89.51 

447.55 

149 

71 

-0.52 

44. 76 

89.51 

447.55 

150 

70 

-0. 59 

44.09 

88.18 

440.92 

151 

70 

-0.59 

44.09 

88.18 

440.92 

152 

70 

-0. 59 

44.09 

88. 18 

440.92 

153 

70 

-0.59 

44. 09 

88.18 

440.92 

154 

70 

-0.59 

44.09 

88. 18 

440.92 

155 

70 

-0.59 

44.09 

88. 18 

440.92 

156 

69 

-0.66 

43.43 

86. 86 

434.28 

157 

69 

-0.66 

43.43 

86. 86 

434.28 

158 

69 

-0.66 

43.43 

86.86 

434.28 

159 

69 

-0.66 

43.43 

86.86 

434.28 

160 

68 

£ 

o' 

i 

42. 76 

85. 53 

427.64 

161 

68 

-0. 72 

42. 76 

85.53 

427.64 

162 

68 

-0. 72 

42. 76 

85.53 

427.64 

163 

68 

-0. 72 

42. 76 

85.53 

427.64 

164 

68 

-0. 72 

42. 76 

85.53 

427.64 

165 

68 

-0. 72 

42.76 

85.53 

427.64 

166 

67 

-0. 79 

42.10 

84.20 

421.00 

167 

67 

-0. 79 

42. 10 

84.20 

421.00 

168 

67 

-0. 79 

42. 10 

84.20 

421.00 

169 

67 

-0. 79 

42. 10 

84.20 

421.00 

170 

67 

-0. 79 

42. 10 

84.20 

421.00 

171 

66 

-0.86 

41.44 

82.87 

414.36 

172 

66 

-0.86 

41.44 

82.87 

414.36 

173 

66 

-0.86 

41.44 

82.87 

414.36 

174 

66 

-0.86 

41.44 

82.87 

414.36 

175 

66 

-0.86 

41.44 

82.87 

414.36 

176 

66 

-0.86 

41.44 

82.87 

414.36 

177 

66 

-0.86 

41.44 

82.87 

414.36 

178 

66 

-0.86 

41.44 

82.87 

414.36 

179 

65 

-0. 92 

40. 77 

81. 54 

407. 72 

180 

65 

-0.92 

40. 77 

81.54 

407. 72 

181 

65 

-0.92 

40. 77 

81.54 

407. 72 

182 

65 

-0.92 

40. 77 

81.54 

407. 72 

183 

65 

-0.92 

40. 77 

81.54 

407. 72 

184 

64 

-0.99 

40.11 

80.22 

401.09 

185 

64 

-0.99 

40. 11 

80.22 

401.09 

186 

64 

-0.99 

40. 11 

80.22 

401.09 

187 

64 

-0.99 

40.11 

80.22 

401.09 

188 

63 

-1.06 

39.44 

78.89 

394.45 

189 

63 

-1.06 

39.44 

78.89 

394.45 

190 

63 

-1.06 

39.44 

78.89 

394.45 

191 

62 

-1.12 

38. 78 

77.56 

387.81 
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s. No 

Farks 

Z-score 

T-score 

AGCT-score 

CEEB-score 

192 

61 

-1. 19 

38.12 

76.23 

381.17 

193 

61 

-1.19 

38.12 

76.23 

381.17 

194 

61 

-1.19 

38.12 

76.23 

381.17 

195 

60 

-1.25 

37.45 

74.91 

374.53 

196 

60 

-1.25 

37.45 

74.91 

374.53 

197 

60 

-1.25 

37.45 

74.91 

374.53 

198 

60 

-1.25 

37.45 

74.91 

374.53 

199 

59 

-1.32 

36.79 

73.58 

367.89 

200 

59 

-1.32 

36.79 

73.58 

367.89 

201 

59 

-1.32 

36. 79 

73.58 

367.89 

202 

58 

-1.39 

36.13 

72.25 

361.26 

203 

58 

-1.39 

36. 13 

72.25 

361.26 

204 

57 

-1.45 

35.46 

70.92 

354.62 

205 

56 

-1 52 

34.80 

69.60 

347. 98 

206 

56 

-1 52 

34180 

69.60 

347.98 

207 

55 

-1. 59 

34.13 

68.27 

341.34 

208 

55 

-1.59 

34. 13 

68.27 

341.34 

209 

54 

-1. 65 

33.47 

66.94 

334 . 70 

210 

54 

-1.65 

33.47 

66.94 

334.70 

211 

53 

-1. 72 

32.81 

65.61 

328.06 

212 

53 

-1. 72 

32.81 

65.61 

328.06 

213 

53 

-1.72 

32 81 

65.61 

328.06 

214 

53 

-1. 72 

32.81 

65.61 

328.06 

215 

51 

-1.85 

31.48 

62.96 

314. 79 

216 

51 

-1 85 

31.48 

62.96 

314.79 

217 

51 

-1.85 

31.48 

62.96 

314.79 

218 

51 

-1.85 

31.48 

62.96 

314. 79 

219 

50 

-1. 92 

30.81 

61.63 

308.15 

220 

46 

- 2.18 

28.16 

56.32 

281.59 

221 

46 

- 2.18 

28.16 

56.32 

281.59 


+ Output from computer 











M*IN 


r>*Tt i*.i ?.hi <55")-l5.as.u* 


P*6f 


OC EC FO*T»*N G 56-10.76 


00M 

on**: 

00#6 

on«7 

On** 

0*«# 

0*5" 

0*51 

005? 

005? 

005# 

0055 


005# 

005# 

006(1 

0061 

006? 

0065 

006# 

006# 

0060 

006 ? 

006 # 

006# 

0070 

0071 

007? 

007? 

007# 

0"75 

007# 

0«77 

007* 

007# 

0«5O 

0061 

0"6? 

008* 

Q0«4 

0065 

006* 

0067 

006* 

0*8# 

0090 

0091 

009? 

0091 

009# 

0095 

009* 

0097 

O"90 

0*90 

0100 


J5(7<T,.i).in.H)Cnio# 

C“(T,.T)*0. 

G*T*7 

6 C w f T .?)=1. 

G* TO 7 

9 C**( T .'1*2. 

7 C*M T I N UF 

*oi o i = i 

*01 OJsl »** 

I#com( j,.n .ru.?. jrotoi o 

#Tf I):#TfIUro(l,Jl 

1" CnNTlK'llF 

0*111=1,N 
0*1?J=1,».? 

IF(rutX,J1.FO.2.JBOT01? 
07(T)»0T(T)*C U (1»-1) 

1? C*ntihuf 

11 FTm=BTfX'-*I f II 

L=**/2 
0*151=1,N 
0*1#J=1 • L 

IF(0M(1,J1.Fu.?.)G0T01« 
fhi n=FMrn+r«f i ,ji 
1# C*NT1*IUF 

15 *1 Hf n=9Tf n-FMfll 

0*151=1 ,U 
0*16J*1,L 
T) 

IF(C*«fI,K1.Fq.?.)C>jTn»6 
RMn)=RMfT)*C“(1,5) 
i* c*NTimiF 

i= wMorn=° t ( n-#M r ii 
PQI NT 5 0 0 
P# J 915 01?? 

501?? =0#P*Tf2», *».»(*. *,?». *#01 L oO' p 5», 

1 T-S c C*N*'.5*. •R*5*C‘'- W »I F * ,//l 
0*501?1T=1 ,H 

SO 1 ? t P#I*T501!,t, #Tf Il.OTMl ,» ' 

5*11 F*«***T ( ? * , 1 T5»10*,l*,F5.>1,Jf?(?*,Fi 

C*tt r0P(FM.5«*l «,#«■?, VF,V*I ,v"?) 
C*tL r0P(#T,9,0T,*«#, VT, W*, Vilfl) 

C*L* eo»f*T.9,ET,*« I , Vn.VF, V(M ) 

C*L»- C0#(#H,9,PM(1, A6X, I/#M, vo*.v*n 


S“*=PT{1) 

«1C«PTfn 

0*6#91I=?,l 


G<ir*«091 
8IG*RT(T) 
J M = 7 


, HIG1 Gf*T*8#9? 
, S«'A1G*T*599'» 


G*T*8#9( 
IMlsPTfI I 
JI“SI 

oomt tniie 

J“I»JTM 


TOTAL' 


«#9? 















00 ec FORTRAN G Sb- 


MAIM 


oatf t*. li.ni (.7sn)-ti.«s,<ib 


PiGF non* 


-in.7b 


0?50 
0 ?t,r> 
02b 1 
0?b? 

0?b7 

0?ba 

02b* 

02bb 

02b7 

02b* 

0?b9 


027* 

0?7b 

0277 

027* 

0270 

0280 

0281 

0262 

0281 

0280 

0281 

028b 

0287 

026* 

0260 

0200 

0201 

020? 

0207 

0200 

020* 

029b 

0207 

029* 

0200 

0700 

0901 

070? 

0707 

070* 

070* 

070b 

0707 

070* 

070° 

0710 

0111 


PPINTbO.SWl,3*2.31*1 
P01WT71 

71 FOOMATf*)*, '3. oui no FORMULA Of PfL T AH II ( Ty • ,//) 

POIOTbO.ROF.RFS.HOO 
PR JOT72 

7? FORMATCIX.*0. FLAMGANS FORMULA OF NFLTAMILI TV•,//I 
PRlNTb9.FnE.FFS.FR0 
PRTMTbOO 

A“R*(A*«*SUOTfvri-SPOT(WOl)/SORT(VT*VO-2.*AF««SO»T(ut*VP)> 
PRIMT730.AMB 

770 FORMATJ/Z/.O*. * RF| TABJI JTY i4V «1)TSFR S«CRT COT MF Twnm , F* , (I) 
C INTERNAL r»*'.9TSTFMC v RE' IAHTL t TV rsTI**ATFS 

S7s0. 

S« = 0. 

L1«4n«27.a 1Oo. 

A*U»L1 
On»ojsl .m 

*0*7(7)*0. 

CV?7 f J1*o, 

00*11sl.L1 

IF(rM(i,ji.Fo.i.)nnTn*2 
TF(C M (T,.n.FO.?.lGnTnO*l1 
»RJ7(J)a«(027(J)*l. 

GOT0811 

6? CR27(.l)»rR27(,l)«l. 

oil tF(j.FQ.iiGnrnfliii? 

GOTflbl 

81112 *a*S**RT(n«PTni 
3F»7S*R7(T1 
81 CONTINUE 

172=N-L1*1 
00871517?.N 

I*(cm(I. J’.fo.i. )r.nrn»o 

IF(CM(l,J).rQ t2> lG<,T0«p 

AMRPrcjiEAwozn.i)*!. 

G070»0 

60 ArR?7(Jl=*C“27(J)*l. 

AO IFf.T.FQ. 1 IGnTOAOROO 

goto*! 

*9909 S938U*RT(T)*WT(T) 

S**9S*RT(t) 

87 C°N7 JNIIF 

80 8TGMA*S7G**A*(MR27'JT«*i»R 2?( 1 )T * f CR27 (.1) * ACR27 f Jl) ? ( AAl *AAI .a) 

A7.?.«AAt 
3*»75/A7 

V*R?7*C**-A?*85«S8)/A? 

6R?nsAM*(l.-712/VT)/(AM-l.) 

KR27«Am»(1.-3TGMA7VAR271/(AM-1 .1 

A*R?0«****f AM«VT-AMtAN«(AM-A* , CANl)/(f** , -1 .1«»M*VT) 

3*sfl. 

S7«o. 

30=0. 

$b*6. 

37=0. 

onaojai.M 

3b=9btl»R ( 7 ) / AN 

37»95+CR(.’)/AN 

3*a38*(CR(J>«NR(J>)/(AN*AN) 






OC EC FORTRAN G 56-10.76 


MMN 


D *7E 16.12.At(3501-15.05, 


PACE 0007 


0X16 OX .99aS9+(CR(.l)*CR(J)l/rAN*ANl 

0317 xPa95/AM 

0310 X0b96/A m 

0510 VARPa(99-AM*xP«xpi /am 

0320 TMKRaAN*(VT-AM*XP*xn+AM»VARP)/(VT*{AM-1.)) 

0321 KR?laAM«fVT-AM*XP*XQ1/((AM-|,)«VT) 

032? fOef«0«*fVT-OOI/f(XM-l.J*WTJ 

C QME3TI0N ANALYSIS TAHI.F. 

0323 

0320 OP»XJ»l.M 

0323 01961 a 1, N 

0326 TF(C«lT,.1).EG.?.>r.nTn9? 

0327 Cf J)«r(.f)*l, 

0320 97 trtc«(i,ji.ro.i.)Ai(ji«Ai(ji*pifn 

0329 90 CONTJNUF 

03|0 CU I>»CfJ>»100./AN 

0331 *T(,T)aAT(.n/Cf J1 

0337 M(.1)«(CR?7fJ1+ACP?7(J)1/(2.*AAI ) 

0333 OT{.?)a(r»?7f J1-AC"?7(J))/AAt 

033« 5*»3W*DT(.1)*Sn»T(VV»HfJ1) 

0333 SHOaSMOAOT ( .1) 

0336 SrFeSFF*FT( ll/ino. 

0337 SFFPaSFF2*F T t J) *F IC .1) /10000. 

033* 03 CONTINUE 

0339 ArofFF«AM*(1 ,-S*/fSF*50l )/(A--l.) 

0300 SATRaAM*(1.-0.*fSFF-SFF?)/SOO)/fA“-1.) 

0301 ATHFal.-t.tO«AMl/VT 

030? P»TNT100,KP?fl,KP?7.AFR?0.K9?I,C0FF.Ar0FFF,S4TR,ATMF 

0383 1«0 FORMAT(///,5X,• RFl!A" 1UTY HV KP-20 FOR'A'U.A',l?X,F10.0,/,5*.'KR-T 

t?1 fOPN. PAOfcO 0* ?•»* MAC ANO 27X L«C ,?X,Flo.<I,/,5 X,’ANTHER FORM 
? ofxw- 20 FllPM,•,1SX,F10,«,/,3Xf'irLTARU ITYPy «o-?J PROP.’.1*X,F10 
5.8, /,XX,’CRONRACK COFF AtPH A • , 2"X , F i o .0 , / , 5* , • L1MFR 90(JND F3TTNAT 
8E OF FX Am RFlIAOII ITV’.1 OX,FJ0.8,/,XX, '9TANI.fV APPROXT m A T 10N ',?2* 
3,F10.o,/,SX, 'TNOEX OF MFAIIRMENI OF F T C T F *'CY ' , F ?5.4 , / / / / ) 

0300 PR1MTA0666,°AU,TMKR 

0103 *66*0 FORMAT(Xx, 'PEI IARII TTT "Y ANAIYSJ3 OF VAM. 1 ,?X,FJ5. a ,//,SX,•TUCKlR 

I MOOIFIFn K-* ’,?*.Ff5.«,///> 

0306 poiMTAOn 

0307 PRTNT9O0 

030* po1NT I 01 

030» 1 n 1 FORMAT (//, 15X, 'QUESTION ANALYSIS TARUF 1 , ///1 

035" PRJ«T600 

0351 pojntio? 

035? |o ? format( 1X, 1 ON. NO',?x,'XCMOnsTNC,?x,'MFAN Amt l TTV *,2X,’FACTLITT• 

1 ,?X. 'OTOCPIMATION* ,?K, 'VARIANCE',/IX, 'NO* ,?X, '(lUFSTtOF" ,6X» ’ INDEX’ 

?,//) 

0353 PPINTAOO 

0358 ontnj.lal," 

0'5* i o a PR|NTi08,.i,rir ji,Aif.n,Fii ji,nic ji.vvAwi j) 

0356 I"« FOfiMAT(ra,F!2.8,2n?,8r?X,?FlX.6) 

0357 PR INT60O 

035* poINTXOO 

035* °W TNT 109 

036" t "9 FOR«aT(?5Y, ’OFRTVFD SCORE TARIE’,///) 

0361 POINT600 

036? PR INT600) 

0363 fc"01 FORMAT!///,?X,*S.no.<,? x,’MARKS’,zx,’ZSCORF<,2X,’T-SCORE’.?X,’AGC 

1T-srn»E’,?x,’CEF9-SC0RE’»/////) 















































































































































































































t o.o e e e 































































































































































































































































































































































































































































































































































































































































f>E»IW€f» T*8tF 


8.NO. 7SCORF T-SC09F *CfT-$fORE CFFB-srOOE 


I 

9 

10 

11 

12 

IS 

1 * 

IS 

10 

17 

18 

19 

20 
21 
22 
2S 
28 
25 
2 * 

27 

28 

29 

50 

51 

52 
33 

38 
15 

30 
37 
S« 

39 
80 
«1 
•2 
»3 
•a 
•S 
•o 
07 
08 
89 

30 

51 

52 

53 

ola 


n». 

no . 

no . 

too. 

» o *. 

10 *. 

108 . 

105 . 

100 . 

too . 

loo. 

103 . 

10 *. 

10 *. 

102 . 

102 . 

* 01 . 

100 . 

100 , 

* 00 . 



99 , 

99 , 


30 . 


9 ". 

97 . 

98 . 
96 . 
96 . 
96 . 
96 , 
96 . 

99 . 
9 *. 
95 . 
95 . 
9 «. 

98 , 

90 . 

90 . 

90 . 

98 . 

9 «. 
92 . 
92 . 
92 . 
91 . 
9 . 1 . 


2.13 71.31 

2.00 70.05 

7.60 70.85 

1.*0 07.99 

*.»0 67.99 

*.*0 67.99 

«.*0 67.99 

*.73 67.32 

*.67 66.66 

*.67 66.66 

*.67 66.66 

*.60 65,99 

*.60 65.99 

*.60 65.99 

*.53 65.33 

1.53 65.35 

*.87 60.66 

*.«0 68.00 

*.80 60.00 

*.80 6«.60 

*.«0 6«,00 

* .*3 63.sa 

*.33 63.38 

1.33 63 . 5a 

1 . 53 63 . 3a 

’.31 63.38 

1.33 63.38 

1.33 63,58 

•.77 62.07 

*,77 62.67 

*.27 67.67 

*.20 62.01 

*.13 61.38 

1.13 61.38 

’.'3 6*.38 

1.13 01.38 

*.13 01.38 

1.13 01.38 

*.07 00,60 

*.07 60.60 

*."7 60 . 6 * 

*.67 60.68 

*."0 60.01 

*,"0 60.0 | 

*."0 60.01 

*,«0 6"."I 

* ."0 60."1 

1,00 60.61 

*.00 60.01 

0.*7 50.08 

0.57 5 *. 6 * 

".•7 50.68 

«."0 5".«2 

«.*0 50.02 


102.62 * 13.12 
101.29 706,07 
* 81.79 706.87 

* 35 . 9 $ 679.80 

* 35 . 9g 679.86 
* 35.90 679,88 
* 35.98 679.88 
* 30.65 673.78 

* 33.32 666.59 
* 33.32 666.69 
133.32 666.59 
* 3!.»9 659.98 
* 31.99 659,08 
* 31.99 659,98 
* 30.66 653.30 
* 30.66 653.30 
* 29.33 686.66 
120.00 680,00 
* 28,00 680,00 
* 2*.00 680,00 
* 20,00 680.00 
* 26.67 633.36 
* 26,67 633.36 
< 26.67 633,36 
126.67 633,56 
* 26.67 633.36 
* 26.67 633.36 
* 26.67 633,36 
125.38 626.71 
* 25.38 626.71 
* 25.38 626.71 
* 20,ot 620.06 
* 27.60 613.02 
* 22,60 613.ap 
* 27 . 6 * 613.82 
* 27.68 613.82 
* 77.60 613,82 
* 27,68 613.82 
* 21.35 606,77 
* 2*.36 606.77 
12*.35 606.77 
12 ’, 35 606,77 
* 20.02 60".*2 
« 20 , n ? 600.12 
12 "."? 60".*2 
170 . 0J 600 . 1 ? 
* 2"."2 600 .*? 
* 20.02 600.12 
120.02 60".*2 
* 17.37 506.83 
* 17.37 586.83 
117.37 506.*3 
116.08 58«.18 
* 16 . 0.8 5gO , 1 » 



























































































































